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What Is Claimed Is: 

1 . An audio-video multiplexed data generating apparatus 
that multiplexes audio data and video data together, 
comprising : 

an audio encoder for encoding inputted audio data; 
an audio data storage for storing the audio data encoded 
by said audio encoder; 

a video encoder for encoding inputted video data; 
a video data storage for storing the video data encoded 
by the video encoder; 

a spare-video encoder for encoding video data at a frame 
rate different from the frame rate of said video encoder; 

a spare-video-data storage for storing the video data 
encoded by said spare-video encoder; 

a synchronization information generator for generating 
synchronization information for synchronizing the audio data 
and the video data when multiplexed data is reproduced; 

a synchronization information storage for storing the 
synchronization information generated by said 
synchronization information generator; and 

an audio-video multiplexer for multiplexing the audio 
data stored in said audio data storage, the video data stored 
in said video data storage, the spare video data stored in 
said spare-video-data storage, and the synchronization 
information generated by said synchronization information 
generator . 

2. The audio-video multiplexed data generating 
apparatus according to claim 1, wherein said spare-video 
encoder encodes the video data at a frame rate lower than the 
frame rate of said video encoder. 

3. The audio-video multiplexed data generating 
apparatus according to claim 1. wherein said spare-video 
encoder does not encode reference picture data but encodes 
difference picture data. 
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4 The audio-video multiplexed data generating 
apparatus according to claim 1. wherein said audio- video 
multiplexer successively multiplexes said spare video data 
supplementing decoding of the video data, in sequence after 
the video data to be supplemented by the decoding. 

5 The audio-video multiplexed data generating 
apparatus according to claim 1. further comprising: 

a spare-audio encoder having the same audio input as said 

audio encoder; and 

a spare-audio-data storage for storing spare audio data 

encoded by said spare-audio encoder; 

wherein said spare-audio encoder generates the spare 
audio data with a simple encoding scheme that requires a 
smaller amount of processing than said audio encoder. 

6 An audio-video multiplexed data reproducing 
apparatus that demultiplexes multiplexed audio-video data, 
comprising: 

an audio-video demultiplexer for demultiplexing inputted 
multiplexed data into audio data, video data, spare video data, 
and synchronization data; 

an audio data storage for storing the audio data 
demultiplexed by said audio-video demultiplexer; 

a video data storage for storing video data demultiplexed 
by said audio-video demultiplexer; 

a spare-video-data storage for storing the spare video 
data demultiplexed by said audio-video demultiplexer; 

a synchronization information storage for storing the 
synchronization information demultiplexed by said audio- 

video demultiplexer; 

an audio decoder for decoding said audio data; 

a video selector for selecting either said video data or 
said spare-video-data to be decoded; 

a video decoder for decoding the video data selected by 
said video selector; and 
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10 . A moving video decoding apparatus 
moving video data, comprising: 
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. vid eo-aecoaing.aetermining module for 
whether or not video aecoaing is completea .rthrn 

ae coded data outputted from said — r r o ir t ea data 

a video display for displaying the color 
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fr>nnp are US ed for said macroblocks the decoding 
the previous frame are usea 

of which is omitted. 

13 The moving video decoding apparatus according to 
cl aim 10, further comprising a motion-vector-determining 
m odule after said video - decoding - determining module but 

, „ k „,i„ if it is determined in said 
before said video decoder, wherein if i f „ 
vl deo-decoding-determining module that it is difficult 
the video decoding to he completed within the predetermine 
tile, macrohlocKs that are determined to have a small mo ion 
ve ctor h y said motion-veetor-determining module are omitted 
fro m the decoding, macrocodes that are determined to have 
. large motion are su bj ected to the decoding, and the same 
..lues that are used in the previous frame are used for the 
macroblocks omitted from the decoding. 

14 The moving video decoding apparatus according to 
Claim 10. further comprising a color conversion determining 
Z le after said video decoder hut hef ore said color converter, 
.herein video data that is determined in said color conversion 

w ,. f f^„n to reproduce in real time 
determining module to be difficult to repr 

iB omitted from processing in a color converter and processing 
in a video display to reduce the amount of processing. 
15 The audio-video multiplexed data reproducing 

j QC ml ,i 1-iolexed data according to any 
apparatus that reproduces multiplexea , ef , oded 
of claims 6 to 9. wherein demultiplexed video data is decoded 
by using the video decoding apparatus according to any of 

claims 10 to 14 . 

16 . An audio- video multiplexed data generating and 
reproducing system that encodes audio data and video data, 
multiplexes the audio and video data together to generate 
ludio video multiplexed data, and reproduces the audio-video 

multiplexed data, wherein, 

t„e step of generating audio-video multiplexed data 

comprises : 
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• riat-a in a video encoder, and 

encoding inputted video data in a via 

generating spare video data in a spare-video encoder by 
encoding the video data at a frame rate different fro, the 
frame rate of said video encoder; 

generating synchronization information for 
synchronizing the audio data and video data during 
reproduction of the multiplexed data; and 

multiplexing an encoded signal of the audio data, a signal 
encoded by the video encoder, said synchroni zatxon 
information, and said spare video data together and 

the step of reproducing audio-video multxplexed data 

comprises the steps of: 

demultiplexing the multiplexed data generated in said 
auaio -video multiplexed data generating step into the audio 
data, video data, synchronization information, and spare 
video data; 

controlling an audio decoder that decodes sard 
demultiplexed audio data and a video decoder that decodes sard 
demultiplexed video data to output reproduced 
r eproduced video in synchronization with each other accordrng 
to said synchronization information; and 

if decoding by said video decoder is not complete in trme 
decoding hy said video decoder the spare video data instead 
of said demultiplexed video data; and when the decoding hy 
said video decoder is completed within a predetermined trme. 
decoding said demultiplexed video data instead of said spare 
data hy said video decoder to restore the original frame rate 
of moving video reproduction. 



